MFSR: Light Field Images Spatial Super Resolution Model Integrated with Multiple Features
نویسندگان
چکیده
Light Field (LF) cameras can capture angular and spatial information simultaneously, making them suitable for a wide range of applications such as refocusing, disparity estimation, virtual reality. However, the limited resolution LF images hinders their applicability. In order to address this issue, we propose an end-to-end learning-based light field super-resolution (LFSR) model called MFSR, which integrates multiple features, including spatial, angular, epipolar plane (EPI), global features. These features are extracted separately from image then fused together obtain comprehensive feature using Feature Extract Block (FE Block) iteratively. Gradient loss is added into function ensure that MFSR has good performance with rich texture. Experimental results on synthetic real-world datasets demonstrate proposed method outperforms other state-of-the-art methods, peak signal-to-noise ratio (PSNR) improvement 0.208 dB 0.274 average 2× 4× tasks, structural similarity (SSIM) both improvements 0.01 average.
منابع مشابه
Super-resolution of Defocus Blurred Images
Super-resolution is a process that combines information from some low-resolution images in order to produce an image with higher resolution. In most of the previous related work, the blurriness that is associated with low resolution images is assumed to be due to the integral effect of the acquisition device’s image sensor. However, in practice there are other sources of blurriness as well, inc...
متن کاملSpatial and frequency-based super-resolution of ultrasound images
Modern ultrasound systems can output video images containing more spatial and temporal information than still images. Super-resolution techniques can exploit additional information but face two challenges: image registration and complex motion. In addition, information from multiple available frequencies is unexploited. Herein, we utilised these information sources to create better ultrasound i...
متن کاملSpatial and Angular Variational Super-Resolution of 4D Light Fields
We present a variational framework to generate super-resolved novel views from 4D light field data sampled at low resolution, for example by a plenoptic camera. In contrast to previous work, we formulate the problem of view synthesis as a continuous inverse problem, which allows us to correctly take into account foreshortening effects caused by scene geometry transformations. High-accuracy dept...
متن کاملLight Field Super-Resolution Via Graph-Based Regularization
Light field cameras can capture the 3D information in a scene with a single shot. This special feature makes light field cameras very appealing for a variety of applications: from the popular post-capture refocus, to depth estimation and imagebased rendering. However, light field cameras suffer by design from strong limitations in their spatial resolution, which should therefore be augmented by...
متن کاملSuper-resolution from Multiple Images Having Arbitrary Mutual Motion
1. INTRODUCTION Video sequences usually contain a large overlap between successive frames, and regions in the scene are sampled in several images. This multiple sampling can sometime be used to achieve images with a higher spatial resolution. The process of reconstructing a high resolution image from several images covering the same region in the world is called Super Resolution. Additional tas...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics
سال: 2023
ISSN: ['2079-9292']
DOI: https://doi.org/10.3390/electronics12061480